Configuring a Versatile LLM Harness & Scraping the Web With Scrapy | Real Python Podcast #304

python
youtube
Configuring a Versatile LLM Harness & Scraping the Web With Scrapy  | Real Python Podcast #304 Which is more important, the model or the "harness" around an LLM? What are ways to assemble an efficient agentic developer workflow? This week on the show, Ayan Pahwa joins us to discuss harnessing, web scraping, and self-hosting Python applications. 👉 Links from the show: Ayan is a developer advocate at Zyte and an experienced project builder. We discuss a recent article he wrote about creating an extension for the web scraping tool Scrapy. He also digs into his self-hosting setup for Python applications and tools. Our discussion extends to the complexities of developing effective harnesses. Ayan shares his setup and how he navigated shifting from prompt engineering to context and loop engineering. This episode is sponsored by [HydraDB]( Topics: - 00:00:00 -- Introduction - 00:02:01 -- Scrapy and building an extension - 00:08:46 -- Zyte and the web scraping API - 00:11:19 -- Sponsor: HydraDB - 00:12:22 -- noalgotube project - 00:15:49 -- Homelab & self hosting projects - 00:22:19 -- What goes into a harness? - 00:32:33 -- Where did you start exploring LLM tools? - 00:36:13 -- Local models & edge computing - 00:39:31 -- ExtractPod and discussing Apple's AI - 00:43:35 -- Video Course Spotlight - 00:44:54 -- Managing token use and tools - 00:52:37 -- What are you excited about in the world of Python? - 00:55:10 -- What do you want to learn next? - 00:56:38 -- What is the best way to follow your work online? - 00:56:58 -- Thanks and goodbye 👉 Links from the show: Do
  2026/07/24      youtube

関連するプログラミング動画 [python]

Our Tag

最近投稿されたプログラミング学習動画

Your LLM's Effective Context Window

python

Download your free Python Cheat Sheet he...

  2026/07/25

Reduce Project Risk by Testing Your Linchpins First

python

Download your free Python Cheat Sheet he...

  2026/07/24

Configuring a Versatile LLM Harness & Scraping the Web With Scrapy |

python

Which is more important, the model or th...

  2026/07/24

My biggest announcement ever

Check out the platform here: Use promo...

  2026/07/24

From Medical Devices to AI DevOps Engineer! 🤯💻

Devops

Think it's too late to change careers in...

  2026/07/24

Codexを使ったAI秘書の活用法を徹底解説!誰でも簡単にセットアップしてCodex秘書を使えるようになります!

本日はCodex秘書についてお話させて頂きました! ぜひご視聴ください! 🧑...

  2026/07/24

Getting Started with Google CoLab | How to use Google Colab

Google

# Getting Started with Google Colab | Ho...

  2026/07/23

Small, Specialized Open Source AI Models

python

Download your free Python Cheat Sheet he...

  2026/07/23

Exploring Python's Built-in Functions: Math-Related Built-Ins & String

python

Download your free Python Cheat Sheet he...

  2026/07/23

GLM 5.2 in Claude Code is Blowing My Mind

Use the Zapier MCP server to connect to ...

  2026/07/23

CI/CD Explained in 5 Minutes

📋 👇 𝗙𝗿𝗲𝗲 𝗖𝗜/𝗖𝗗 𝗖𝗵𝗲𝗰𝗸𝗹𝗶𝘀𝘁 — 𝗬𝗼𝘂𝗿 𝗖𝗼𝗺𝗽𝗹𝗲𝘁𝗲...

  2026/07/23

RAG Explained The Most In Demand Pattern in AI Engineering

RAG, or retrieval augmented generation, ...

  2026/07/23

How to Use Claude Design 🚀 Complete Beginner Guide

Design

# How to Use Claude Design In this step...

  2026/07/22

Count Your Lines of Code by File Type With Tallyman

python

Download your free Python Cheat Sheet he...

  2026/07/22

Your AI Agent Is Probably Hackable. Fix It in 30 Minutes

Deploy Hermes securely here: Deploy Ope...

  2026/07/22

Stop Guessing at Prompts Learn How Models Actually Work

Once you understand how large language m...

  2026/07/22